Papers with generation of guardrail models
On Guardrail Models’ Robustness to Mutations and Adversarial Attacks (2025.findings-emnlp)
Copied to clipboard
| Challenge: | generative AI systems providing unsafe information has raised significant concerns, emphasizing the need for safety guardrails. |
| Approach: | They propose to evaluate 15 state-of-the-art guardrail models to assess their robustness to input mutations and adversarial attacks designed to bypass models’ safety alignment. |
| Outcome: | The proposed models are robust to input mutations and adversarial attacks that bypass models’ safety alignment. |